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SUBJECT 


Training  DevolopnanC  Study  Plan:  Coat  and  Training 

EffectlvaneHH  Analyala  (CTEA)  of  tha  CH-47  Plight  Simulator 
(CH47PS)  ACM  23879 


TO:  SEE  DISTRIBUTION 


1.  Purpose.  To  determine  the  cost  and  training  effectiveness  of  the 
CH47FS  when  utilized  in  the  CH-47  Aviator  Qualification  Course  (AQC) 
and  CH-47  aviator  unit  training.  The  results  of  this  study  will  be 
used  to  determine  the  USATRADOC  position  for  the  CH47FS  Development 
Acceptance  (DEVA)  In  Process  Review  (IPR)  scheduled  for  October  1977. 

This  study  falls  into  category  1,  Manpower  and  Personnel  (DOD  Dir  5010.22) 

2.  References . See  Inclosure  1. 


3.  Study  Sponsor.  US  Army  Training  Support  Center,  Ft.  Eustis,  VA  23604 
The  study  sponsor’s  representative  is  Juri  Toomepuu,  DAC,  AUTO VON  927- 
4812/4813/4218. 


US  Army  Aviation  Center,  Pt.  Rucker,  AL  36362 


a.  Problem:  The  CH47FS  program  was  undertaken  to  improve  the  cost 

and  training  effectiveness  of  CH-47  aviator  training.  The  problem  re- 
quiring resolution  includes  verification  of  the  anticipated  benefits, 
justification  of  further  expenditures,  and  the  optimization  of  the  cost 
and  training  effectiveness  of  the  CH47PS  program. 


(1)  Determine  the  training  effectiveness  of  each  alternate  training 


(2)  Estimate  the  pertinent  costs  of  each  alternate  training  package. 

(3)  Determine  the  coat  and  training  effectiveness  of  each  alternate 
training  package. 

(4)  Rank  order  the  alternate  training  packages  on  the  basis  of  appro' 

prlata  quantitative  cost  and  training  effectiveness  measures,  and  judge- 
mental evaluations  of  the  situations  in  which  the  alternates  are  expected 
to  be  used.  r . 


(5)  Prepare  a recommended  CH47FS  basls-of- Issue  plan  (BOIP)  for  the 
preferred  packages. 

(6)  Ascertain  the  lapact  each  alternate  training  package  will  have 
upon  Amy-wide  conbat  readiness  of  Army's  CH-47  assets. 

c.  Scope.  The  study  will: 

(1)  Address  the  cost  and  training  effectiveness  of  the  alternate 
training  packages  listed  In  paragraph  51  below,  considering  anticipated 
resource  constraints,  conbat  readiness  of  the  Army's  CH-47  assets,  and 
safety. 

(2)  Include  a review  of  the  Synthetic  Flight  Training  Systen  (SFTS) 
Training  Device  Requirement  (TDK) , CARDS  Kef  No.  0027. 

(3)  Recnsnand  a BOIP  for  the  CH47FS. 

d-  Tine  frana:  1977  through  1986.  This  reflects  the  tine  frane 

of  the  Aviation  Requirements  for  the  Conbat  Structure  of  the  Arny  III 
(ABCSA  III)  Study.  See  paragraph  5f(2)  below.  Beyond  this  tine  frane 
quantities  and  distributions  of  CH-47' s are  not  flrn. 

e.  Limits. 

(1)  Data  supporting  the  effectiveness  analyses  will  be  obtained 
from  the  Developmental  Test/Operational  Test  II  (DT/OT  II)  of  the 
CH47FS  prototype,  the  office  of  the  CH-47  Modernization  Project  Manager, 
Project  Manager  Training  Devices,  and  a search  of  relevant  literature. 

(2)  The  study  will  address  the  Impact  of  the  CH47FS  (training  device 
2B31)  on  the  cost  and  training  effectiveness  of  aviator  training  and  on 
the  conbat  readiness  of  the  Amy's  CH-47  assets.  Other  training  devices 
■ud  the  relative  cost-effectiveness  of  the  separate  components  of  the 
CH47FS  will  not  be  addressed. 

f . Assertions . 

(1)  Conclusions  of  the  CH-47  Modernisation  Program  Concept  Formulation 
Package  (CFP)  (July  1975)  are  valid. 

(2)  Kaconmandatlona  of  the  ARCSA  III  Study  pertaining  to  CH-47 
quantities  and  distributions  will  be  approved. 

(3)  The  draft  CH-47  Aircrew  Training  Manual,  aa  proposed  by  USAFORSCOM, 
will  be  approved  by  HQDA. 
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(4)  Changes  in  doctrine  and  tactics  for  employment  of  medium  lift 
helicopters  will  not  significantly  affect  CH-47  aviator  training  through- 
out the  time  frame  of  this  study. 

(5)  The  state-of-the-art  of  flight  simulator  technology  will  con- 
tinue improving,  but  there  will  be  no  major  breakthroughs  that  would 
render  the  current  generation  of  flight  simulators  or  their  major  sub- 
systems obsolete  during  the  time  frame  of  the  study. 

(6)  The  current  ground  training  In  the  CH-47  AQC  is  valid. 

g.  Essential  Elements  of  Analysis  (EEA) . The  following  questions 
must  be  resolved  In  order  to  achieve  the  purpose  of  the  study  and  to 
address  the  Implications  of  Introducing  the  simulator  into  the  Army 
Inventory. 

(1)  What  are  the  costs  of  the  alternate  training  packages? 

(2)  What  are  the  training  costs  per  aviator  for  the  alternate 
training  packages? 

(3)  At  what  point  in  the  life  cycle  of  the  alternate  training 
packages  (which  include  the  use  of  the  CH47FS)  will  their  costs  be 
equal  to  the  costs  of  the  baseline  training  packages  (using  the  CH-47 
only)? 

(4)  What  Is  the  training  effectiveness  of  each  alternate  training 
package? 

(5)  What  is  the  relative  cost  and  training  effectiveness  of  each 
alternate  training  package? 

(6)  What  flight  maneuvers  and  procedures  (if  any)  cannot  or  should 
not  be  practiced  in  the  simulator?  What  flight  procedures  and  maneuvers 
(if  any)  can  or  should  be  practiced  in  the  simulator  only? 

(7)  To  what  extent  will  the  training  received  by  the  aviator  in 
the  CH47FS  be  transferred  to  actual  operation  of  the  aircraft?  (i.e., 
what  is  the  training  transfar  ratio?) 

(8)  What  is  the  recomssnded  mix  of  simulator  and  aircraft  training? 

(9)  What  are  the  potential  contributions  of  the  CH47FS  to  combat 
readiness  training? 

(10)  What  are  the  safety  benefits  of  the  CH47FS , in  terms  of  accident 
costs  and  casualty  rates,  that  may  be  expected  from  less  exposure  of 
aviators  to  training  in  aircraft?  (To  be  answered  by  the  US  Army  Agency 
for  Aviation  Safaty  (USAAAVS)) . 


3 


(11)  For  each  year  in  the  study  time  frame,  what  is  the  projected 
aviator  input  for  the  CH-47  AQC? 

(12)  What  should  be  the  basis  of  issue  of  the  CH47FS? 

(13)  On  the  basis  of  cost  and  training  effectiveness,  should  the 
CH47FS  simulate  the  CH-47D?  If  so,  what  are  the  resulting  costs? 

(14)  What  are  the  technical,  schedule,  and  cost  risks  associated 
with  the  CH47FS  program?  (To  be  answered  by  Project  Manager,  Training 
Devices  (PM  TRADE)) . 

(15)  What  are  the  reliability,  availability,  and  maintainability 
characteristics  of  the  CH47FS,  and  how  do  these  characteristics  affect 
the  cost  and  training  effectiveness  of  CH-47  aviator  training?  (To  be 
answered  by  the  US  Army  Aircraft  Development  Test  Activity  (USAADTA)  and 
the  CH47FS  Study  Group) . 

(16)  What  are  the  resource  implications  of  each  alternate  training 
package,  considering,  in  addition  to  the  costs/benefits  measured  in 
dollars,  the  requirements  for  manpower,  fuel,  training  airspace,  areas, 
facilities,  time,  and  environmental  consequences? 

(17)  Can  a reduction  in  cost  be  achieved  by  a modification  of  the 
CH47FS  in  light  of  maneuvers  that  should  not  be  practiced  in  the  simulator 
(see  EEA  6) ? (To  be  answered  by  PM  TRADE) . 

(18)  What  are  the  flight  standardization  advantages/disadvantages 
of  each  alternate  training  package? 

h.  Constraints . None. 

i.  Alternate  Training  Packages.  For  the  purpose  of  this  study,  CH-47 
aviator  training  is  categorized  as  either  unit  or  institutional  training. 

Unit  training  will  be  construed  to  include  all  CH-47  aviator  training  other 
than  initial  qualification  or  instructor  pilot  (IP)  training,  whether  or 
not  the  unit  training  involves  members  of  CH-47  units.  Unit  training  in- 
cludes aircrew  re-qualification  training  (individual  and  unit),  combat 
readiness  flying  (CRF) , operational  flying  for  training  purposes,  and  pro- 
ficiency flying.  It  excludes  operational  flying  for  mission  support  since 
such  support  can  only  be  provided  by  actual  aircraft  (even  though  such  flying 
may,  and  often  will  be  credited  against  CRF  mlnimums) . Each  training  package 
includes  the  hardware  on  which  training  will  be  taught  (i.e.,  the  simulator 
and/or  the  CH-47)  and  the  method  of  its  utilization,  as  well  as  appropriate 
training  literature  providing  instructions  and/or  guidance.  The  following 
training  packages  will  be  addressed: 
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(1)  Institutional  Training  (IT). 

(a)  Use  of  the  CH-47  only  (baseline). 

(b)  Maximum  use  of  the  CH47FS  supplemented  by  the  CH-47  only  for 
maneuvers  and  procedures  that  cannot  be  practiced  or  performed  in  the 
flight  simulator. 

(c)  Use  of  the  CH47FS  and  the  CH-47 , In  accordance  with  a program 
of  Instruction  (POI)  determined  by  the  study  agency  as  study  progresses. 

(2)  Unit  Training  (UT) . 

(a)  Use  of  the  CH-47  only  (baseline) . 

(b)  Maximum  use  of  the  CH47FS  supplemented  by  the  CH-47  only  for 
maneuvers  and  procedures  that  cannot  be  practiced  or  performed  In  the 
flight  simulator. 

(c)  Use  of  the  CH47FS  and  the  CH-47,  In  accordance  with  a POI 
determined  by  the  study  agency  as  study  progresses. 

J . Measures  of  Training  Effectiveness  (MOTE) . 

(1)  Aviator  performance  evaluation  scores. 

(2)  The  hours  of  training  necessary  to  attain  the  following  per- 
formance objectives: 

(a)  Institutional  Training  (IT):  To  provide  a CH-47  qualification 

course  (transition)  student  with  the  skills  necessary  to  enable  him  to 
successfully  complete  the  aircraft  type  qualification  examination  (i.e., 
to  achieve  a minimum  score  of  70)  under  the  meteorological  conditions 
which  allow  for  safe  flight  of  the  aircraft  and  permit  performance  of  re- 
quired maneuvers  and  aklll  demonstration. 

(b)  Unit  Training  (UT):  To  provide  a CH-47  aviator  with  the  practice 

necessary  to  maintain  the  skills  required  to  successfully  complete  the 
aircraft  examination  ride  (l.e.,  to  achieve  a minimum  score  of  70)  under 
the  meteorological  conditions  cited  above. 

(3)  Other:  To  be  developed  by  the  study  agency  and  approved  by  the 

study  sponsor  and/or  Study  Advisory  Group  (SAG). 

k.  Methodology. 

(1)  Selection  of  the  preferred  alternate  will  be  made  on  the  basis 
of  a variable  cost/fixed  effectiveness  analysis  and  military  judgment. 
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(2)  Effectiveness  methodology  (see  Inclosure  2). 

(3)  Cost  methodology  (see  Inclosure  3) . 

l.  Models.  Models  will  be  identified  by  the  study  agency  and  used 
as  needed. 

m.  Related  Studies.  See  Inclosure  1. 

6.  Environment  Threat  Guidance:  Threat  application,  as  necessary,  will 

be  conducted  using  USATRADOC  standard  combat  development  scenarios  IAU 
USATRADOC  Regulation  71-4. 

7.  Support  and  Resource  Requirements. 

a.  Support  Requirements. 

(1)  HQ  USATRADOC 

(a)  Provide  guidance  and  assistance  in  development  of  methodology 
and  collection  of  data. 

(b)  In  conjunction  with  USAFORSCOM,  furnish  data  on  current  and 
projected  CH-47  aviator  strengths  and  densities  throughout  the  Army. 

(2)  HQ  USAFORSCOM . 

(a)  Provide  input  as  indicated  in  7a(l)(b)  above  and  other  data  as 
needed. 

(b)  Provide  CH-47  qualified  aviators  for  subjects  in  the  unit  training 

test. 

(3)  US  Army  Training  Support  Center. 

(a)  Establish  and  chair  a SAG. 

(b)  Provide  guidance  to  the  study  agency. 

(4)  US  Army  Transportation  Center.  As  the  proponent  for 

the  CH-47,  provide  information  on  force  structure,  organisation,  basis- 
of-lasue. and  concept  of  operation. 

(5)  USATRADOC  Coordinating  Centers  and  Aasociated  Schools  and  Centers. 
Provide  data  pertaining  to  the  study,  generated  or  collected  by  them  in 

the  course  of  carrying  out  their  assigned  miss lot,  and  function. 

(6)  US  Army  Aviation  Board.  Provide  assistance,  guidance  and  data 
relative  to  the  DT/OT  II  supporting  the  study. 
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(7)  HQ  PSADABCOM  (PM  TBADE) . Provide  data  essential  to  the  conduct  of 
the  study  (cost,  performance,  schedule,  risk,  RAM  end  others  as  requested). 

(8)  HQ  PSADARCOM  (PM  CH-47  Modernisation  Program) . Provide  data 
relative  to  aircraft  production  schedules,  cockpit  configuration,  and 
other  data  impacting  upon  the  CH47FS. 

(9)  US  Army  Research  Institute.  Provide  the  necessary  consulting 
services  throughout  the  conduct  of  the  study. 

(10)  US  Army  Agency  for  Aviation  Safety.  Provide  data  and/or  support 
to  the  safety  analysis  in  the  study. 

(11)  Comptroller  of  the  Army.  Provide  cost  data  and/or  validation 
of  cost  estimates  as  necessary. 

(12)  US  Army  Aviation  Teat  Activity  (PROV) . Provide  RAM  data 
generated  by  the  CH47FS  De~  ipmsnt  Test  (DT  II) . 

(13)  US  Army  Aviation  Center  and  Fort  Rucker. 

(a)  Provide  the  necessary  administrative  support  to  conduct  the  study. 

(b)  Prepare  and  submit  statements  of  work  and  requests  for  contrac- 
tual support,  if  required. 

(c)  Request  data  and/or  assistance,  as  required,  from  the  agencies 
listed  above. 

b.  Resource  Requirements. 

(1)  Participants  In  the  study  will  be  funded  by  their  parent  organiza- 
tions. 

(2)  Automated  Date  Processing  requirements  will  be  identified  by  the 
study  agency. 

(3)  The  study  agency  will  provide  the  study  group  members  and  physical 
facilities  for  the  conduct  of  the  study. 

8.  Admin is tratlon : 

s.  Study  Title.  Cost  and  Training  Effectiveness  Analysis  (CTEA) 
of  the  CH-47  Flight  Simulator  (CH47FS) . Short  title:  CH47FS  CTEA. 


b.  Study  Schedule.  See  Inclosure  4 


c.  Control  Procedures.  The  following  control  procedures  have  been 
established  by  the  study  directive. 

(1)  A SAG  will  be  established  and  chaired  by  the  US  Army  Training 
Support  Center  1AW  AH  5-5. 

(2)  The  SAG  will: 

(a)  Review  the  study  plan  and  methodology  and  any  statement  of  work 
or  request  for  contractual  support. 

(b)  Conduct  reviews  and  evaluations  of  the  study  agency  efforts  and 
Issue  guidance  as  appropriate. 

(c)  Review  and  approve  the  draft  final  report  prior  to  publication. 

(d)  The  SAG  will  be  composed  of  the  Chairman  and  the  Deputy  Chairman, 
designated  by  the  study  sponsor,  and  a member  of  each  of  the  following 
agencies: 

(1)  HQDA  (DCSOPS) 

(2)  USAFORSCOM 

(3)  USADARCOM  (PM  TRADE) 


(4)  USAAVNC 

(5)  U8ATCPE 

(e)  Observers  from  interested  agencies  may  be  invited  to  attend  SAG 
meetings  at  the  discretion  of  the  chairman  or  his  deputy. 

d.  EEA  Format.  EEAs  will  be  written  in  accordance  with  the  format 
and  guidance  of  Inclosure  5. 

e.  Approving  Authority.  The  USATRADOC  Deputy  Chief  of  Staff,  Train- 
ing, has  the  approving  authority  for  the  study  plan  and  the  final  report. 

f.  Action  Documents.  A proposed  BOIP  for  the  CH47FS  will  be  prepared 
and  submitted  as  part  of  the  study  report. 


ized  direct  communication  with  all  DA  agencies  below  HQDA. 
h.  Distribution. 


The  study  agency  Is  author- 


(1)  Tan  copies  of  the  study  plan  and  the  final  report  will  be  sub- 
mitted to  the  study  sponsor.  In  addition,  copies  will  be  furnished  to 
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agencies  IAW  the  distribution  for  the  study  directive,  plus  12  copies 
of  the  study  report  to  the  Defense  Documentation  Center  (DDC) , two  copies 
to  the  Defense  Logistics  Study  Information  Exchange  (DLSIE),  and  a copy 
to  the  Army  Library  in  the  Pentagon. 

(2)  Interim  and  draft  reports  will  be  distributed  to  the  study 
sponsor  and  the  members  of  the  SAG  only. 


i.  Security  Classification  Guidance. 
71-3  and  AR  380-5. 


See  Appendix  F,  USATRADOC  Pam 


9.  Correlation: 

a.  USATRADOC  Action  Control  Numhgr:  ACN  23879. 

b.  Points  of  Contact: 

(1)  USATRADOC  POC  is  the  Study  Sponsor's  representative. 

(2)  Study  agency  POC  is  CPT  Thomas  C.  Mowdy,  Jr.,  AUTOVON  558-6316/ 


5418. 


5 Inclosures 

1.  References 

2.  Effectiveness  Methodology 
w/Tabs  A & B 

3.  Cost  Methodology 

4.  Milestone  Schedule 

5.  Generalised  Outline  for  EEA 

DISTRIBUTION: 

See  next  page 


PAUL  F.  GORMAN 
Major  General,  GS 
Deputy  Chief  of  Staff 
for  Training 
HQ  TRADOC 
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EFFECTIVENESS  METHODOLOGY 


1.  PURPOSE.  To  identify  the  data  requirements  and  the  methodology  to 

be  used  in  computing  the  values  of  the  measures  of  training  effectiveness 
(MOTE)  of  the  alternate  training  packages. 

2.  MEASURES  OF  TRAINING  EFFECTIVENESS  (MOTE). 

a.  Hours  of  training  necessary  to  attain  the  performance  objective 
criteria. 

b.  Aviator  performance  evaluation  scores. 

3.  These  items  of  data  will  be  collected  in  the  Developmental  Test/ 
Operational  Test  II  (DT/OT  II)  of  the  CH47FS« 


a. 

Trials  per  task. 

b. 

Performance  per  trial. 

c. 

Time  per  trial. 

d. 

Time  per  task. 

e. 

Total  hours  of  training  per  aviator. 

f. 

Aviator  performance  score  per  task  on 

examination  rides. 

8- 

Overall  aviator  performance  score  per 

examination  ride. 

4.  INSTITUTIONAL  TRAINING. 

a.  Alternate  training  packages  la  and  lb.  Number  of  hours  of  train- 
ing and  aviator  performance  evaluation  scores  will  be  collected  for  these 
training  packages  in  DT/OT  II.  The  values  of  the  MOTE  for  each  of  these 
training  packages  will  be  determined  using  the  DT/OT  II  data  as  follows: 

(1)  The  mean  number  of  hours  of  training  will  be  computed  for  each 
training  package. 

(2)  The  mean  aviator  performance  score  on  the  aircraft  examination 
ride  will  be  computed  for  each  training  package. 

b.  Alternate  training  package  lc.  This  training  package  is  a mix 
of  simulator  and  aircraft  training.  The  actual  mix  will  be  determined  as 
DT/OT  II  data  becomes  available.  A description  of  the  analysis  used  in 
defining  this  training  package  and  the  value  of  its  MOTE  follows: 
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(1)  The  aean  number  of  hours  Co  Crain  each  Cask  Co  criceria  using 
training  packages  la  and  lb  will  be  computed.  These  training  hours  will 
be  designated: 

Aj,  - Mean  number  of  hours  to  train  the  task  to  criteria  using  only 
the  aircraft  (training  package  la) . 

S»  - Mean  number  of  hours  to  train  the  task  to  criteria  or  to  the 
highest  practical  proficiency  attainable  in  a reasonable  time. by  using 
only  the  simulator  (training  package  lb) . 

A,  m Mean  number  of  hours  (if  any)  to  train  the  task  to  criteria 
in  the  aircraft  following  Sg  hours  of  training  in  the  simulator  (training 
package  lb) . 

(2)  Selection  of  tasks  more  effectively  learned  in  the  simulator 
and  tasks  more  effectively  learned  in  the  aircraft  will  be  based  on  the 
relationship  between  Ac,  S^,  and  Ag  for  each  task. 

(3)  If  Ag  > Ac>  the  task  should  be  learned  in  the  aircraft. 

(4)  If  A_  £ A , the  cumulative  transfer  effectiveness  function 
(CTEF)  for  the  taskSrlll  be  computed  as: 

CTEF  . ^ ~ S 

*« 

(a)  If  the  CTEF  for  the  task  > 1,  the  task  is  more  effectively 
learned  in  the  simulator. 

(b)  If  the  CTEF  for  the  task  4 1,  the  effectiveness  of  the  simulator 
is  equal  to  or  less  than  the  effectiveness  of  the  aircraft  in  learning  the 
taak.  In  this  case,  other  determining  factors  must  be  considered. 

(5)  The  mix  of  simulator  awl  aircraft  time  in  training  package  lc 
will  evolve  from  the  above  taak  selection  process.  Training  package  lc 
will  be  defined  in  terM  of  tasks  more  effectively  learned  in  the  simulator 
and  tasks  more  effectively  learned  in  the  aircraft. 

(6)  The  mean  number  of  houra  of  training  and  the  naan  aviator 
performance  score  will  be  computed  for  this  training  package. 

3.  UNIT  TRAINING. 

a.  Alternate  training  packages  2a  and  2b. 

(1)  The  mean  aviator  performance  score  on  the  initial  aircraft  ex- 
amination ride  will  be  computed  to  eatabllsh  a proficiency  baseline. 
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(2)  The  mean  number  of  hours  of  training  und  the  mean  performance 
scorea  on  the  final  aircraft  examination  will  be  computed  as  in  paragraph  4a. 

b.  Alternate  training  package  2c.  The  methodology  described  in 
paragraph  4b  will  be  used  in  defining  the  mix  of  simulator  and  aircraft 
time  and  the  value  of  the  MOTE  for  training  package  2c.  DT/OT  11  data 
for  training  packages  2a  and  2b  will  be  used  in  the  analysis. 
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CH-47  FLIGHT  SIMULATOR  TRANSFER  OF  INSTITUTIONAL  TRAINING  TEST  PLAN 

Prepared  by  Dr.  Garvin  L.  Holman 

US  Army  Research  Institute  Field  Unit 
Fort  Rucker,  Alabama  36362 


1.  GENERAL  OVERVIEW.  The  objective  of  this  study  is  to  experimentally 
determine  the  transfer  of  training  from  the  CH-47  Flight  Simulator  (CH47FS) 
to  the  CH-47  aircraft.  The  experimental  and  control  subjects  will  be 
aviators  from  the  regular  CH-47  Aviator  Qualif ication  Course  classes. 

Aviators  will  be  trained  in  the  simulator  to  performance  criteria,  then 
tested  and  retrained  as  necessary  in  the  aircraft.  The  basic  data  will  be 
the  savings  in  training  accomplished  by  using  the  simulator  compared  to 
training  in  the  aircraft  only.  See  Figure  1 for  a flow  chart  of  the 
entire  study. 

2.  OBJECTIVES.  The  objective  of  this  study  is  to  experimentally  determine 
the  extent  that  institutional  training  in  the  CH47FS  will  transfer  to  the 
operation  of  the  CH-47  aircraft.  The  transfer  of  training  will  be  measured 
on  a maneuver  by  maneuver  or  task  by  task  basis.  The  transfer  of  training 
data  will  allow  decisions  to  be  made  concerning  the  improvement  of  the 
simulator,  improvement  of  simulator  and  aircraft  training  programs  and 

the  determination  of  the  cost-effectiveness  of  the  simulator  in  a training 
program. 

3.  PRE- EXPERIMENTAL  ACTIVITIES. 

a.  There  are  many  tasks  to  be  accomplished  before  the  experimental 
program  begins.  The  following  is  a discussion  of  some  of  these  pre- 
experlmental  activities. 

b.  A program  of  instruction  and  flight  training  guide  must  be  developed 
for  use  in  the  CH47FS  and  in  the  CH-47  by  the  experimental  group.  This 
training  program  will  be  a modification  of  the  current  CH-47  training 

guide  that  applies  to  institutional  training  in  the  aircraft.  Changes 
that  will  be  made  in  the  present  program  will  be  to  allow  flight  instructors 
to  take  advantage  of  the  unique  training  capabilities  of  the  simulator. 

The  simulator  has  demonstration  programs,  checkride  programs,  and  capa- 
bilities for  demonstrating  a student's  performance,  evaluating  a student's 
performance  and  changing  the  training  situation  or  location  abruptly 
without  having  to  spend  valuable  training  time  flying  an  aircraft  from 
one  place  to  another.  The  training  guide  specifies  each  maneuver  and  task 
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to  be  taught  and  practiced  in  detail  with  the  exception  of  the  simulator- 
unique  features.  The  same  training  guide  will  be  used  by  the  aircraft 
only  training  group. 

c.  Each  maneuver  will  be  defined  in  objective  terms  small  enough 
to  be  meaningful  in  the  evaluation  but  large  enough  to  be  graded  by  an 
instructor  pilot  or  observer.  For  example,  a landing  could  be  broken  down 
into  very  small  tasks  such  as  movements  of  the  cyclic,  thrust  control, 
rudder  pedals,  and  other  activities,  or  the  maneuver  of  landing  could  be 
broken  into  larger  segments  such  as  approach  to  base  leg,  turn  to  final, 
final  approach  and  touch  down,  or  the  landing  maneuver  could  be  considered 
as  a whole.  The  definitions  of  maneuvers  and  tasks  will  define  them  in 

an  optimal  manner  to  maximize  the  value  of  the  experimental  data  and  to 
make  them  operationally  meaningful  and  easy  for  an  instructor  to  objec- 
tively grade. 

d.  Evaluation  criteria  are  spelled  out  alongside  the  flight  training 
guide  mentioned  above.  These  criteria  specify  the  precision  with  which 
each  task  or  maneuver  is  to  be  performed.  It  is  these  criteria  that  the 
subjects  will  be  trained  against  in  the  simulator  and  the  aircraft  and 
will  be  tested  against  in  all  checkrides. 

e.  New  grading  sheets  for  use  in  dally  training  and  checkrides 
will  be  developed  based  on  the  maneuver  and  task  definitions  and  the 
performance  criteria  developed  above.  These  grading  sheets  will  be 
used  routinely  throughout  the  test. 

f.  An  IP/student  opinion  survey  will  be  developed  to  assess  IP  and 
student  opinions  of  the  simulator.  The  subjects  covered  will  include 
the  simulator  hardware,  simulator  operational  characteristics,  the 
training  program,  and  the  special  training  features. 

g.  Before  the  transfer  of  training  study  begins  the  CH47FS  must  be 
declared  ready  for  training.  This  means  that  the  acceptance  test 
procedures  have  been  completed  and  that  there  are  no  major  deficiencies 
that  will  affect  training  in  the  simulator. 

h.  The  Instructor  pilots  (IPs)  selected  for  participation  in  the 
simulator  phase  of  the  transfer  of  training  study  will  be  given  a two- 
week  course  In  the  operation  of  the  simulator  by  the  simulator  manufacturer. 
It  is  expected  that  five  instructor  pilots  from  the  Aviation  Center  and 

two  instructor  pilots  from  USAFORSCOM  will  participate  in  this  course . The 
course  will  be  an  introduction  to  the  CH47FS  that  will  teach  the  IPs 
how  to  operate  the  simulator  and  to  use  the  instructor's  control  console 
in  the  simulator  cockpit. 

i.  Following  the  simulator  manufacturer's  two-week  IP  course  there 
should  be  a two-week  Experimental  Procedures  Course  provided  by  the 
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transfer  of  training  atudy  personnel  to  familiarize  the  IPs  with  the 
experlaental  procedures  and  materials  being  used.  This  familiarization 
will  include  the  modified  program  of  instruction  and  the  use  of  all  the 
training  aids  available  in  the  simulator.  The  IPs  will  also  have  to  be 
trained  In  the  training  and  evaluation  criteria  to  be  used  In  the  train- 
ing program,  the  maneuver  and  task  definitions  developed  and  the  use  of 
the  specialized  grading  sheets.  This  will  also  provide  an  opportunity 
for  the  IPs  to  use  one  another  and  perhaps  others  as  test  students  In 
practicing  training  procedures  In  the  simulator. 

j . The  IPs  that  will  be  teaching  the  control  group  will  have  to  take 
a portion  of  the  Experimental  Procedures  Course.  They  must  know  the 
program  of  instruction,  the  maneuver  and  task  definition,  the  training 
and  evaluation  criteria  and  the  use  of  the  specialized  grading  sheets. 

k.  Lastly,  there  is  a vast  amount  of  coordination  that  must  be  done 
to  insure  that  all  phases  of  the  program  proceed  on  schedule.  Local 
units  that  coordination  must  be  accomplished  with  include  the  Test 
Board,  the  Directorate  of  Combat  Developments,  the  Directorate  of 
Training  Developments,  the  US  Army  Research  Institute,  the  Department  of 
Graduate  Flight  Training  and  perhaps  others. 

4.  EXPERIMENTAL  PROCEDURES.  The  following  general  specifications  of  the 
program  of  experimentation  describe  the  major  variables  to  be  controlled, 
the  general  procedures  to  be  used  in  data  gathering,  the  nature  of  the 
data  to  be  collected  and  the  methods  of  data  reduction,  analysis  and 
interpretation.  It  does  not  include  step-by-step  directions  for  the 
detailed  management  of  the  experimental  program  as  these  will  be  developed 
as  the  program  matures.  Supplemental  material  such  as  the  training  guides 
with  maneuver  and  task  definition,  performance  criteria  and  grading  sheets 
will  appear  as  appendices  to  this  test  plan. 

a.  Subject?- 

(1)  The  subjects  for  this  study,  both  experimental  and  control,  will 
all  come  from  the  dozen  or  so  student  aviators  in  the  normal  Department 

of  the  Arm,  CH-47  Aviator  Qualification  Course  classes  that  will  be  going 
on  at  the  time  of  the  study.  Four  subjects  will  be  selected  from  each 
class  as  the  experimental  simulator  training  subjects.  They  will  be 
selected  on  the  basis  of  their  prior  flight  experience  and  other  criteria 
so  as  to  prevent  biasing  the  test  due  to  undue  concentrations  of  inexper- 
ienced or  experienced  aviators  being  used.  Those  students  in  the  class  not 
selected  as  experimental  subjects  will  be  the  subjects  in  the  control 
group  that  receive  aircraft  training  only. 

(2)  The  four  subjects  from  each  class  will  receive  the  normal  academic 
training  during  one-half  of  the  day  and  the  simulator  or  aircraft  training 
during  the  other  half  of  the  day.  With  overlapping  classes  the  CH47FS 
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will  be  in  use  eight  hours  per  day.  The  test  program  will  use  24  subjects 
(6  classes)  and  is  anticipated  to  run  2*>  weeks  from  the  start  of  subject 
training. 

b.  Simulator  Training  Procedures. 

(1)  Subjects  will  be  trained  on  tasks  and  maneuvers  in  the  CH47FS  in 
the  same  order  as  those  tasks  and  procedures  are  trained  in  the  aircraft 
as  specified  in  the  training  guide.  Training  in  the  simulator  will 
proceed  until  an  acceptable  criterion  of  performance  is  reached.  That 

is,  training  in  the  simulator  will  not  be  stopped  or  continued  according 
to  time.  Training  will  proceed  until  a subject  can  perform  the  task  or 
maneuver  to  the  criteria  set  out  in  the  flight  training  guide.  In  the 
event  that  an  aviator  does  not  learn  a particular  task  or  maneuver  in 
the  simulator,  training  will  be  stopped  when  it  is  evident  that  further 
improvement  is  unlikely.  This  will  prevent  undue  time  being  spent  in  the 
attempted  training  of  skills  at  which  the  simulator  is  inefficient.  De- 
tails of  these  procedures  will  be  taught  to  the  IPs  in  the  Experimental 
Procedures  Course  before  the  start  of  the  experiment. 

(2)  During  the  course  of  training,  performance  data  will  be  recorded  by 
the  IPs  on  each  task  and  maneuver.  The  experimental  grade  sheets  will 

be  used  and  the  data  will  include  the  task  or  maneuver  being  practiced, 
a measure  of  the  student's  performance  on  each  trial  and  the  time  de- 
voted to  each  maneuver.  The  use  of  the  grade  sheet  and  the  performance 
measures  will  be  taught  in  the  Experimental  Procedures  Course.  To 
maintain  quality  control  in  data  collection  each  IP  will  be  periodically 
monitored  and  retrained  in  the  experimental  procedures  as  required. 

(3)  The  last  phase  of  simulator  training  will  be  a checkrlde  in  the 
simulator  over  all  the  maneuvers  trained  in  the  simulator.  Any  maneuver 
not  performed  to  criteria  in  the  checkrlde  but  earlier  trained  to  cri- 
teria will  be  retrained  and  retested. 

(4)  From  time  to  time  during  training  and  at  the  conclusion  of  the 
simulator  checkrlde  the  IPs  and  students  will  take  the  opinion  survey. 

This  will  allow  the  determination  of  trends  of  opinion  changes  and  may 
help  to  emphasize  good  and  bad  features  of  the  simulator  or  the  training 
program. 

(5)  At  the  end  of  the  simulator  training  phase  of  the  experiment  the 
following  data  elements  will  have  been  collected  for  each  subject  and 
each  task  or  maneuver,  numerically  designated  as  indicated: 

(a)  The  number  of  times  each  maneuver  was  practiced.  (1) 

(b)  A measure  of  the  student's  performance  on  each  trial.  (2) 
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(c)  The  time  spent  practicing  each  maneuver.  (3) 

(d)  A listing  of  those  tasks  or  maneuvers  that  could  not  be 
learned  to  criterion.  (4) 

(e)  The  total  time  of  simulator  training.  (5) 

(f)  A measure  of  the  student’s  performance  in  a simulator  checkride 
on  each  task  or  maneuver.  (6) 

c.  Simulator  Group  Aircraft  Checkride.  At  the  completion  of  simulator 
training  the  simulator  trained  subjects  will  go  directly  to  the  aircraft 
for  an  aircraft  checkride.  They  will  not  do  preflight  or  other  procedures 
nor  will  they  have  any  familiarization  time  in  the  aircraft.  The  purpose 

of  this  checkride  is  to  determine  which  of  the  tasks  and  maneuvers  taught 
in  the  CH47FS  need  no  further  training  in  the  aircraft  and  which  ones  do 
require  additional  training  in  the  aircraft.  The  checkride  will  cover 
all  those  maneuvers  that  were  taught  in  the  simulator  and  will  be  done 
to  the  standards  of  performance  required  in  the  simulator  training.  The 
same  grade  sheets  and  performance  criteria  will  be  used.  At  the  end  of 
this  checkride  a measure  of  the  student’s  performance  on  each  task  or 
maneuver  in  the  aircraft  after  only  simulator  training  will  have  been 
collected  (7). 

d.  Simulator  Group  Aircraft  Training 

(1)  The  simulator  trained  group  will  have  two  phases  of  aircraft 
training;  one  to  enable  us  to  assess  the  training  value  of  the  simulator, 
and  a second  to  train  the  qualification  students  on  those  maneuvers  and 
procedures  for  which  the  trainer  was  not  designed. 

(2)  The  first  phase  of  aircraft  training  will  cover  those  tasks  and 
maneuvers  that  the  subjects  were  unable  to  pass  on  the  checkride  just 
completed  in  the  aircraft.  These  tasks  and  maneuvers  will  be  trained  to 
criterion  just  as  they  were  in  the  CH47FS.  The  same  training  guide, 
maneuver  definitions,  performance  criteria  and  grading  sheet  will  be 
used.  The  same  data  that  was  collected  in  the  simulator  will  be  collected 
in  the  aircraft.  When  these  tasks  and  maneuvers  are  trained  to  criterion, 
the  transition  subjects  may  progress  to  the  second  phase. 

(3)  In  the  second  phase  the  qualification  subjects  will  be  taught 
those  tasks  and  maneuvers  not  covered  in  the  simulator  training.  Such 
operations  Include  water  and  slope  operations,  preflight  procedures  and, 
perhaps,  others.  These  maneuvers  and  procedures  will  also  be  taught  to 
a criterion  performance  level  just  as  all  previous  training  has. 

(4)  At  the  end  of  aircraft  training  the  following  additional  data 
will  have  been  collected  for  each  maneuver  not  adequately  learned  in  the 
CH47FS: 
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(•)  The  number  of  times  each  maneuver  was  practiced.  (8) 

(b)  A measure  of  the  student's  performance  on  each  trial.  (9) 

(e)  The  time  spent  practicing  each  maneuver.  (10) 

(d)  The  total  time  of  aircraft  training.  (11) 
e.  Final  Checkride. 

(1)  At  this  point  the  qualification  student  should  be  ready  for  the 
final  checkride.  Checkrides  will  be  administered  in  the  same  manner  as 
the  previous  checkrides  and  the  same  data  will  be  collected.  Failure  in 
any  maneuver  will  require  more  training  and  another  checkride.  At  the 
conclusion  of  this  checkride  a measure  of  the  student's  performance  on 
each  task  or  maneuver  in  the  aircraft  after  aircraft  training  will  have 
been  collected.  (7) 

(2)  This  completes  the  experimental  procedures  for  the  experimental 
(simulator  trained)  group.  See  Figure  2 for  a flow  chart  of  these 
procedures.  The  following  is  a description  of  the  experimental  pro- 
cedures for  the  control  (aircraft  trained)  group. 

5.  CONTROL  GROUP  AIRCRAFT  TRAINING  PROCEDURES.  The  control  group  will 
receive  all  of  its  training  in  the  aircraft  and  no  training  in  the  simulator. 
The  aircraft  training  will  be  identical  to  that  the  experimental  group 
receives  in  the  simulator  in  that  training  will  be  performed  to  the  same 
criterion  standards  and  the  same  type  data  will  be  collected.  The  training 
guide  of  the  simulator  training  program  will  be  used  but  without  reference 

to  the  simulator-unique  training  features.  The  same  maneuver  definitions, 
performance  criteria  and  grading  aheets  will  be  used.  The  control  IPs 
will  require  training  in  these  procedures  and  will  have  to  attend  part 
of  the  Experimental  Procedures  Course,  The  training  will  also  include 
those  tasks  and  maneuvers  not  taught  in  the  simulator  which  are  normally 
part  of  the  CH-47  Aviator  Qualification  Course.  At  the  end  of  control 
group  training  the  following  data  will  have  been  collected  for  each 
control  subject  and  each  task  or  maneuver: 

a.  The  number  of  times  each  maneuver  was  practiced.  (8  ) 

b.  A measure  of  the  student's  performance  on  each  trial.  (9  ) 
e.  The  time  spent  practicing  each  maneuver.  (10) 

d.  The  total  time  of  aircraft  training.  (11) 

6.  CONTROL  GROUP  AIRCRAFT  CHECKRIDE. 


7 


a 


a.  Following  training  to  criterion  In  the  aircraft, the  control  group 
will  receive  a checkrlde  Identical  to  the  final  aircraft  checkride 
designed  for  the  simulator  trained  group.  If  a student  does  not  pass 
this  checkrlde  he  will  receive  more  training  and  another  checkride  until 
he  can  paaa  it.  Data  will  be  collected  in  this  further  training  and 
checkrlde  just  as  it  was  collected  in  the  original  training  and  checkride. 
Additional  data  collected  will  be  a measure  of  the  student's  performance 
on  each  task  or  maneuver  in  the  aircraft  after  only  aircraft  training  (7). 

b.  See  Figure  3 for  a flow  chart  of  these  procedures. 

7.  DATA  REDUCTION.  The  data  collected  can  be  reduced  to  measures  of 
transfer  of  training  such  as  the  percent  of  transfer  of  training  or 
cumulative  transfer  effectiveness  ratios  for  each  task  and  maneuver  that 
was  trained  in  the  simulator.  These  data  will  allow  the  determination  of 
which  tasks  and  maneuvers  transfer  most  effectively  from  the  training 
received  in  the  simulator  to  the  final  performance  expected  in  the  air- 
craft. From  such  figures  conclusions  may  be  drawn  concerning  the  improve- 
ment of  the  simulator,  improvement  of  the  simulator  and  aircraft  training 
program,  and  the  determination  of  the  cost-effectiveness  of  the  use  of 
the  simulator  in  institutional  training  program.  In  addition  to  the 
data  mentioned  above,  there  will  be  considerable  data  of  an  opinion 
nature  derived  from  both  the  instructor  pilots  and  the  students  that 
participated  in  the  experiment. 


2S 


Tab  B to  Incl  2 


CH-47  FLIGHT  SIMULATOR  TRANSFER  OF  UNIT 
FLYING  TRAINING  TEST  PLAN 

Prepared  by  Dr.  Garvin  L.  Holman 

US  Army  Research  Inetltute  Field  Unit 
Fort  Rucker,  Alabama  36362 


4 * ’ 

1.  GENERAL  OVERVIEW.  The  objective  of  this  study  Is  to  experimentally 
determine  the  maintenance  of  unit  flying  In  the  CH-47  Flight  Simulator 
(CH47FS).  The  experiment  Involves  the  training  of  a group  of  aviators 
for  six  months  in  the  CH47FS,  and  at  the  end  of  that  time,  testing  them 
in  the  aircraft.  The  control  group  with  similar  training  and  testing  in 
the  aircraft  will  be  run  for  comparison  purposes.  See  Figure  1 for  a 
flow  chart  of  the  entire  study. 

2.  OBJECTIVE.  The  objective  of  this  study  is  to  experimentally  determine 
the  extent  that  unit  flying  skills  trained  in  the  CH47FS  will  be  maintained 
and  transfer  to  the  aircraft.  The  determination  will  be  made  on  a 
maneuver  by  maneuver  or  task  by  task  basis  of  maneuvers  and  tasks  that 
can  be  performed  both  in  the  CH47FS  and  the  aircraft.  Such  an  experimental 
analysis  of  the  maintenance  of  proficiency  will  allow  decisions  to  be 
made  concerning  improvements  in  the  simulator,  improvement  of  any  training 
program  in  which  the  simulator  is  a part,  and  a determination  of  cost- 
effectivenass  of  the  simulator  in  a unit  flying  training  program. 

3.  PRE-EXP ERI MENTAL  ACTIVITIES. 

a.  Several  preparations  must  be  made  before  the  beginning  of  the 
experimental  program.  The  following  is  a discussion  of  some  of  these 
activities  and  reaaons  for  their  necessity. 

b.  A training  guide  for  unit  flying  training  must  be  developed 
that  will  be  followed  by  the  experimental  subject  aviators  participating 
in  this  experiment. 

c.  At  the  time  the  training  program  is  being  devised,  maneuvers 

and  tasks  to  be  included  in  the  program,  and  against  which  the  performance 
of  the  aviator  will  be  Judged,  will  be  carefully  defined.  This  will 
insure  that  all  aviators  have  explicit  information  as  to  the  maneuvers 
and  tasks  they  are  to  perform  and  the  manner  in  which  they  should  be 
performed.  Such  control  of  training  is  essential  to  obtain  valid  test 
information. 
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d.  Closely  related  to  the  above  activity  Is  the  determination  of 
the  criteria  against  which  aviator  performance  will  be  evaluated.  These 
criteria  will  not  only  be  used  In  evaluation  phaaas  of  the  program  but 
In  the  training  phases  in  that  thaae  are  the  criteria  to  which  aviators 
will  be  trained  to  perform. 

e.  Equally  important  and  again  Interrelated  to  the  above  activities 
Is  the  development  of  grading  sheets.  These  sheets  will  be  used  in  day 
to  day  training  activities  and  in  the  evaluation  phases  of  the  program. 
They  will  insure  that  a uniform  method  is  used  to  evaluate  aviators' 
performance  on  the  various  maneuvers  and  tasks  and  that  the  data  is  all 
in  the  same  form  and  readily  available  for  evaluation. 

f.  In  addition  to  these  activities,  another  very  Important  activity 
Is  that  of  coordination.  Coordination  will  be  necessary  between  various 
units  at  Fort  Rucker  such  as  the  Test  Board,  Directorate  of  Training 
Developments,  Directorate  of  Combat  Developments,  US  Army  Research  In- 
stitute, Department  of  Graduate  Flight  Training,  and  perhaps  others. 
Activities  at  Fort  Rucker  will  have  to  be  coordinated  through  various 
units  and  USAFORSCOM  which  is  expected  to  provide  instructor  pilots  (IPs, 
and  aviator  subjects  for  this  test  program. 

g.  IPs  will  have  lc  be  assigned  to  participate  in  this  flight  simu- 
lator test  program  at  Fort  Rucker.  These  IPs  will  go  through  a two-week 
course  in  which  they  learn  how  to  operate  the  simulator  and  use  it  as  a 
training  device  followed  by  another  two-week  course  in  which  they  learn 
the  desired  training  guide,  the  maneuver  and  task  evaluation  criteria, 
and  how  to  train  to  criteria  and  evaluate  the  subject  aviators. 

4.  EXPERIMENTAL  PROCEDURES. 

a.  Subjects . 

(1)  The  subjects  for  this  experiment  will  be  16  USAFORSCOM  aviators 
assigned  to  operational  CH-47  units.  The  subjects  must  be  carefully 
chosen  against  several  criteria.  They  must  be  available  to  participate 

in  the  study  for  six  months  from  the  start  date.  They  and  their  unit  must 
be  willing  for  them  to  stop  all  their  flying  activities  during  this  six- 
month  period  except  for  essential  CH-47  missions  and  for  the  simulated 
flying  received  in  the  program.  They  must  also  be  free  to  come  to  Fort 
Rucker  once  a month  for  a few  days  to  participate  in  the  simulation  train- 
ing program. 

(2)  The  control  group  subjects  will  be  16  USAFORSCOM  aviators  very 
much  like  the  simulator  group  subjects.  They  must  be  willing  and  able  to 
participate  in  the  experiment  for  six  months,  including  not  flying  any 
aircraft  except  the  CH-47  on  essential  missions. 
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b.  Simulator  Training  Proaram. 

(1)  Bach  of  the  16  subject  avlatora  will  coae  to  Fort  Rucker  for  a 
two  or  three-day  period  one  week  out  of  every  four.  Prior  to  cowing, 
each  aubject  will  have  taken  a checkrlde  In  the  CH-47  aircraft  identical 
to  the  one  that  will  be  given  at  the  end  of  the  program.  This  will  estab- 
lish a proficiency  baseline  against  which  the  results  of  further 
training  can  be  compared.  At  the  end  of  the  initial  checkrlde  a measure 
of  the  subject's  performance  on  each  task  or  maneuver  in  the  aircraft 
before  specific  training  In  the  CH47FS  will  have  been  collected  (7). 

(2)  On  each  two  or  three-day  period,  the  subjects  will  receive  five 
hours  of  flight  instruction  and  practice  in  the  CH47PS  ao  that  at  the 
end  of  six  months  each  subject  will  have  accumulated  a total  of  30  hours 
of  training  in  the  simulator.  The  training  will  not  be  conducted  on  an 
hourly  basis  but  to  a performance  criterion.  The  training  guide  will 
specify  the  maneuvers  to  be  trained  on  and  practiced,  but  the  training 

of  a particular  task  or  maneuver  will  not  take  place  for  a particular 
period  of  time.  Instead,  the  training  will  continue  until  the  aviator 
can  perform  the  task  or  maneuver  to  a predetermined  criteria.  In  the 
event  that  an  aviator  does  not  learn  a particular  task  or  maneuver  in 
the  simulator,  training  will  be  stopped  when  It  Is  evident  that  further 
improvement  is  unlikely.  This  will  prevent  undue  time  being  spent  in 
the  attempted  training  of  skills  at  which  the  simulator  Is  Inefficient. 

At  this  point  the  training  will  continue  on  another  task  or  maneuver. 

In  this  way  subject  aviators  will  maintain  their  flying  proficiency  in 
all  tasks  and  maneuvers  expected  in  the  CH-47  aircraft. 

(3)  Data  will  be  collected  in  the  simulator  covering  the  number  of 
times  that  each  task  or  maneuver  was  practiced,  an  evaluation  of  the 
subject  aviator's  performance  of  each  task  or  msneuver,  and  the  time  spent 
in  practicing  that  task  or  maneuver. 

(4)  The  last  phase  of  simulator  training  will  be  a checkrlde  in  the 
simulator  over  all  the  maneuvers  trained  in  the  simulator.  Any  maneuver 
not  performed  to  criteria  In  the  checkrlde  but  earlier  trained  to  cri- 
teria will  be  retrained  as  time  allows.  At  the  end  of  the  simulator 
phase  of  the  experiment  the  following  data  will  have  been  collected  for 
each  subject  end  each  task  or  maneuver: 

(a)  The  mrnber  of  times  each  maneuver  was  practiced.  (1) 

(b)  A measure  of  the  subject's  performance  on  each  trial.  (2) 

(c)  The  time  spent  practicing  each  maneuver.  (3) 

(d)  A listing  of  those  tasks  or  maneuvers  that  could  not  be  learned 
to  criterion.  (4) 
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(e)  The  total  time  of  simulator  training.  (5) 

(f)  A measure  of  the  student's  performance  In  a simulator  checkrlde 
on  each  task  or  maneuver.  (6) 

(g)  The  time  each  aviator  flew  the  CH-47  aircraft  and  the  types  of 
missions  and  maneuvers  flown.  (1?). 

c.  Simulation  Group  Aircraft  Checkrlde.  At  the  end  of  the  six-month 
period,  each  of  the  16  aviators  will  receive  a checkrlde  in  the  CH-47 
aircraft.  This  checkrlde  will  cover  all  the  essential  procedures  that 
were  practiced  in  the  simulator.  The  data  from  this  checkrlde  vill 
consist  of  evaluations  of  the  subject  aviator's  performance  on  each  task 
or  maneuver  requested  of  him  In  the  checkrlde  (7).  Additional  data  col- 
lected at  this  stage  will  be  a measure  of  each  student's  performance  on 
each  task  or  maneuver  In  the  aircraft  after  six  months  of  CH47FS  training. 
This  completes  the  experimental  procedures  for  the  experimental  (simulator 
trained)  group.  See  Figure  2 for  a flow  chart  of  these  procedures.  The 
following  Is  a description  of  the  experimental  procedures  for  the  control 
group . 

d.  Control  Group  Training.  The  Initial  event  in  the  control  group 
will  be  a checkrlde  In  the  aircraft  Identical  to  those  given  the  experi- 
mental group.  Each  subject  will  then  fly  only  essential  CH-47  missions. 

Ho  other  flying  will  be  allowed. 

e.  Control  Group  Checkrlde. 

(1)  The  control  group  will  take  a checkrlde  identical  to  that  described 
above  for  the  simulation  group.  The  same  data  will  be  collected.  See 
Figure  3 for  a flow  chart  of  control  group  procedures. 

(2)  The  data  to  be  collected  are: 

(a)  Initial  performance  measures  of  each  maneuver  in  an  aircraft 
checkrlde.  (7) 

(b)  Performance  measures  of  each  maneuver  in  the  final  aircraft 
checkrlde.  (7)' 

(c)  The  time  each  aviator  flew  the  CH-47  aircraft  and  the  types  of 
missions  and  maneuvers  flown.  (12) 

5.  DATA  REDUCTION.  The  data  from  the  training  procedures  and  testing 
procedures  above  will  be  reduced  to  percent  transfer  of  training  and 
cumulative  transfer  effectiveness  of  the  simulator  In  training  the  vari- 
ous coabat  readiness  flying  tasks  and  maneuvers.  Prom  this  reduced  data 
suggestions  will  be  made  for  improvement  of  the  simulator,  Improvements 
In  training  programs  using  the  simulator,  and  a determination  of  the 
cos t-ef feet lveneas  of  training  programs  using  the  simulator. 
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Figure  3.  Plow  Chart  of  Control  Group  Procedures. 
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COST  ANALYSIS  METHODOLOGY 

1.  PURPOSE.  To  Identify  the  date  requirements  and  the  methodology  to 
be  used  in  determining  the  pertinent  costs  of  the  alternate  training 
packages.  The  cost  analysis  Is  designed  to  answer  (wholly  or  in  part) 
the  following  EEA: 

a.  What  are  the  costs  of  the  baseline  training  packages  for  the 
time  frame  of  the  study? 

b.  What  are  costs  of  the  alternate  training  packages  which  employ 
the  CH47FS  for  the  same  period? 

c.  What  are  the  training  costs  per  aviator  for  the  alternate 
training  packages? 

d.  What  are  the  safety  benefits  of  the  CH47FS,  In  terms  of  accident 
costs  and  casualty  rates,  that  may  be  expected  from  less  exposure  of 
aviators  to  training  in  aircraft? 

e.  What  are  the  technical,  schedule,  and  cost  risks  associated 
with  the  CH47FS  program? 

f.  Can  a reduction  in  cost  be  achieved  by  a modification  of  the 
CH47FS  in  light  of  maneuvers  that  should  not  be  practiced  in  the  simulator? 

2.  GROUND  RULES. 

a.  All  costs  Incurred  through  FY  77  will  be  considered  as  sunk 
costs  and  will  be  identified  as  such,  but  will  not  be  Included  in  life 
cycle  cost  estimates  (LCCE). 

b.  LCCE  for  the  CH47FS  will  be  developed  in  accordance  with  AR  11- 
18  and  DA  Pam  11-2,  11-3,  11-4,  11-5. 

c.  Flight  Simulator  (FS)  LCCE  will  be  developed  for  buy  sizes  of 
one  to  ten  units.  Additional  LCCE  will  be  computed  on  larger  buy  sizes. 

If  required,  during  the  course  of  the  study. 

d.  A 15-year  operating  life  (1977  - 1991)  will  be  used  to  develop 
LCCE  for  the  CH47FS. 

e.  Future  purchases  of  CH-47C  and  CH-47D  aircraft  for  training 
purposes  will  be  considered.  Procurement  cost  of  previously  (before  FY 
78)  purchased  training  aircraft  will  be  considered  sunk. 


f.  Operating  and  Support  (O&S)  costa  will  be  computed  based  on 
annual  operating  hours  of  2000  through  4000  hours. 

3.  METHODOLOGY. 

a.  There  are  two  types  of  training  packages  to  be  addressed, 
institutional  training  (IT)  and  unit  training  (UT).  The  alternate 
training  packages  are: 

(1)  Institution ’training. 

(a)  Use  of  the  CH-47  only  (IT  baseline), 

(b)  Maximum  use  of  the  CH47FS  supplemented  by  the  CH-47  only  for 
maneuvers  and  procedures  that  cannot  be  practiced  or  performed  in  the 
flight  simulator. 

(c)  Use  of  the  CH47FS  and  the  CH-47,  in  accordance  with  a program 
of  instruction  (P0I)  determined  by  the  study  agency  as  study  progresses. 

(2)  Unit  training. 

(a)  Use  of  the  CH-47  only  (UT  baseline), 

(b)  Maximum  use  of  the  CH47FS  supplemented  by  the  CH-47  only  for 
maneuvers  and  procedures  that  cannot  be  practiced  or  performed  in  the 
flight  simulator. 

(c)  Use  of  the  CH47FS  and  the  CH-47,  in  accordance  with  a program 
of  instruction  (FOI)  determined  by  the  study  agency  as  study  progresses. 

b.  The  cost  of  each  alternate  training  package  will  be  determined 
as  follows  (the  same  baelc  equation  is  applicable  for  both  institutional 
(IT)  and  unit  training  (UT): 

(1)  Training  Cost  per  Aviator  for  I1*1  Alternate 

Training  Package  - tc^ 

tc*  - lira  . Cost/Hr  + Hrs  • Cost/Hr 

AC  AC  PS  FS 

(2)  Total  Cost  for  ith  Alternate 

Training  Package  ■ TC^ 

TC^  ■ No.  of  Aviators  • tc^ 
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c.  To  support  the  above,  the  following  subanalyses  will  be  conducted: 

(1)  LCCE  will  be  developed  for  the  FS  for  buy  sizes  of  one  to  ten 
units.  Additionally,  the  modification  cost  of  converting  a CH47FS  from 
a CH-47C  to  a CH-47D  aircraft  simulator  will  be  determined. 

(2)  LCCE  (adjusted  to  FT  78  dollars)  for  those  CH-47C  and  CH-47D 
to  be  purchased  for  training  will  be  determined.  * 

(3)  Scheduling,  technical,  and  cost  risks  associated  with  the 
CH47FS  will  be  identified,  and  their  Impact  upon  costs  will  be  addressed. 

d.  In  addition  to  the  analyses  described  in  paragraph  3b  and  c 
above,  a side  analysis  will  be  conducted  to  determine  the  safety  benefits 
in  terms  of  costs  and  casualties  avoided  to  be  accrued  by  training  in 

the  CH47FS  in  lieu  of  the  CH-47  aircraft.  This  analysis  will  be  requested 
from  the  US  Army  Agency  for  Aviation  Safety  (USAAAVS). 

4.  DATA  SOURCES. 

a.  OCOA/USADARCOM 

(1)  FS  and  AC  LCCE 

(2)  Modification  costs  of  CH-47C  to  OJ-47D  aircraft  simulator 

(3)  Schedule,  technical,  and  cost  risks 

b.  USAFORSCOM 

(1)  Unit  training  data 

(2)  Aviator  densities 

c.  USAAAVS 

CH-47  safety,  accident,  and  flying  hour  analyses 

d.  USAAVNC 

Institutional  training  data 
a.  DA 

Projected  student  loads 
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GENERALIZED  OUTLINE  FOR  ESSENTIAL  ELEMENTS  OF  ANALYSIS  (EEA) 

FOR  THE  FINAL  REPORT 
CH-47  FLIGHT  SIMULATOR  (CH47FS) 

COST  AND  TRAINING  EFFECTIVENESS  ANALYSIS  (CTEA) 


1.  Purpose,  Objectives,  Problem,  and/or  Background. 

2.  Assumptions  and/or  Limitations. 

3.  Scope. 

4.  Discussion. 

a.  Methodology 

b.  Sources  of  Deta 

c.  Discussion  or  Analysis 

5.  Conclusions  and/or  Raco—snrlatione 

6.  References. 


MOTES:  1.  Each  abbreviation,  acronya,  ter*  used  end  its  weaning , as  well 

as  each  reference  cited,  la  to  be  furnished  on  a 3"  X 5"  card  in  the  format 
prescribed  by  USATRADOC  Paaphlet  71-3. 

2.  Paragraphs  1,  2,  and  3 cited  above  are  to  be  used  only  es  needed. 

3.  The  EEA  is  to  be  written  per  the  following  pages. 

, / 
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FORMAT  PAGE  NUMBERING,  AND  SOME  RULES  OF  STYLE  FOR 
EEA  IN  THE  FINAL  REPORT, 

CH-47  FLIGHT  SIMULATOR  (CH47FS) 

COST  AND  TRAINING  EFFECTIVENESS  ANALYSIS  (CTEA) 


1.  FORMAT.  f 

a.  Text.  The  format  for  an  EEA  la  shown  In  attachment  1.  Assign- 
ment of  appendices  to  EEA  will  be  announced  by  the  study  agency  as  study 
progresses. 

b.  Figures. 

(1)  All  graphic  or  tabular  Information  supportive  to  the  text  will 

be  labeled  as  figures.  That  is,  there  will  be  no  "graphs,"  "Illustrations," 
"tables,"  etc. 

(2)  Each  figure  will  be  no  less  than  one  page  and  will  imnedlately 
follow  the  page  on  which  It  is  first  cited. 

(3)  The  format  for  figures  Is  shown  In  attachment  2. 

(a)  The  figures  In  the  executive  auamary  and  main  report  will  be 
□uebered  consecutively  with  arable  numerals. 

(b)  Figures  In  appendices  will  also  be  numbered  consecutively  with 
arable  niasarals  preceded  by  the  letter  of  the  appendix  and,  as  applicable, 
the  roman  numeral  of  the  annex,  the  lower  case  letter  of  the  lnclosure, 
and  the  arable  nmeral  of  the  tab  In  which  the  figure  appears.  E.g. , 
reeding  this  figure  number  from  right  to  left,  "Figure  M-I-b-3-5"  denotes 
that  this  la  the  fifth  figure  of  tab  3 of  lnclosure  b to  annex  I of 
appendix  M. 

2.  PAGE  NUMBERING.  All  pages  will  be  nuabered,  including  those  of 
figures. 

a.  Executive  Summry  end  Mel"  Pages  of  the  executive 

summery  end  main  report  will  be  umbered  consecutively  with  arable 
numerals. 

b.  Appendices . 

(1)  Pages  contained  In  appendices  will  be  umbered  consecutively 
with  arable  numerals  preceded  by  the  letter  of  the  appendix  and,  as 


2 


4* 


applicable,  the  roaan  numeral  of  the  annex,  the  lower  case  letter  of 
Indoeure,  and  the  arable  numeral  of  the  tab  In  which  It  Is  located. 

(2)  For  each  appendix,  annex,  lnclosure,  and  tab,  the  text  always 
begins  on  the  3d  page;  the  2d  page  Is  left  blank;  and  the  1st  page  Is 
the  title  page. 

3.  SOME  RULES  OF  STYLE. 

a.  Abbreviations  and  Acronyms . 

(1)  The  executive  suMery,  main  report  and  appendices  are  to  be 
written  to  stand  alone  without  recourse  to  the  study  glossary.  Therefore, 
acronyms  and  abbreviations  are  to  be  defined  where  they  first  appear  In 
the  text.  Only  the  acronyms  and  abbreviations  will  be  used  In  subsequent 
pages,  annexes,  lndosurea,  and  tabs. 

(2)  If  an  abbreviation  or  acronym  will  appear  only  once  In  the 
text.  It  shall  not  be  used. 

(3)  All  agencies  will  receive  their  full  title  and  be  accordingly 
abbreviated,  e.g.,  "US  Army  Training  and  Doctrine  Comsand  (USATRADOC)", 
not  "US  Army  Training  and  Doctrine  Command  (TRADOC)"  or  "US  Army  Research 
Institute  (USARI)"  not  "US  Army  Research  Institute  (ARI) " . 

b.  Humbers. 

(1)  Cardinal  numbers  of  ten  or  less  will  be  written,  e.g.,  "nine 
simulators",  but  "13  aircraft". 

(2)  Ordinal  numbers  will  be  expressed  with  numerals,  e.g.,  "2d 
place”  and  "The  alternate  ranks  6th." 

c.  Percent.  The  word  "percent"  will  always  be  used  in  the  text  in 
lieu  of  "X". 
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APPENDIX  'LL 


EEA  39 

1.  PARAGRAPH  TITLE. 

a.  Subparagraph  Titla. 

(1)  Sub-subparagraph  Titla. 

(2)  Sub-subparagraph  Titla. 

b.  Subparagraph  Titla. 

2.  PARAGRAPH  TITLE. 
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Figure  M-I-b-3-5 . An  Example  of  a Figure 


